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An information service provider network includes a content 
gateway to process requests for information from a client 
terminal. The content gateway includes a router for receiv- 
ing a request for information from the client terminal. The 
request includes a domain name and additional content. The 
router forwards the request according to the domain name to 
a selected one of a plurality of processors to further process 
the request. The selected one of the plurality of processors 
identifies an information source to satisfy the request in 
response to the additional content of the request. 
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SYSTEM AND METHOD FOR PROCESSING 
A REQUEST FOR INFORMATION IN A 
NETWORK 

TECHNICAL FIELD OF THE INVENTION 



The present invention relates in general to Internet infor- 
mation retrieval processing and more particularly to a sys- 
tem and method for processing a request for information in 
a network. 10 

BACKGROUND OF THE INVENTION 

Routing technology has evolved from simple L3 routing 
based on destination Internet Protocol (IP) address to L4/L5 15 
routing based on source destination IP addresses, port num- 
bers, and protocol type. Recently, routing has been based on 
the information request itself. To date, content routing 
functions are typically located in the proximity of the servers 
or data centers with routing approaches that consider only 20 
the domain name of the information request. With distrib- 
uted data centers and object replication, it is often possible 
to retrieve an object to satisfy an information request from 
multiple servers thai arc geographically dispersed. More- 
over, the desired content may not be located at the closest 25 
server. Thus, inefficiencies result when an object is down- 
loaded from a server that is far away from the request 
originator or is overloaded. This difficulty is further exac- 
erbated when a request is sent to one server only to have it 
redirected to another server. Therefore, efficiencies and 30 
response time improvement can be gained if the best server 
can be determined at the edge of the network. 

SUMMARY OF THE INVENTION 

35 

From the foregoing, it may be appreciated by those skilled 
in the art that a need has arisen for a system and technique 
that can locate an appropriate server to fulfill an information 
request by using only the contents of the request. In accor- 
dance with the present invention, a system and method for 40 
processing a request for information in a network are 
provided that substantially eliminate or greatly reduce dis- 
advantages and problems associated with conventional con- 
tent routing techniques. 

According to an embodiment of the present invention, 45 
there is provided a system node for processing a request for 
information that includes a router to receive a request for 
information. The request includes a domain name and addi- 
tional content. The router forwards the request to a selected 
one of a plurality of processors according to the domain 50 
name associated with the request. The selected processor 
identifies an information source to fulfill the request accord- 
ing to the additional content of the request. 

The present invention provides various technical advan- 
tages over conventional content routing techniques which 55 
may or may not be required to practice the claimed inven- 
tion. For example, one technical advantage is to determine 
a source of information based on the additional content of a 
request apart from the domain name associated therewith. 
Another technical advantage is to provide a subscription 60 
service to content providers so that associated requests may 
have accelerated processing. Yet another technical advan- 
tage is to locate an efficient server capable of satisfying the 
request and provide a connection thereto for retrieval of 
requested information. Still another technical advantage is to 65 
avoid penalizing traffic that does not have a subscription for 
accelerated processing. Other technical advantages may be 



readily ascertainable by those skilled in the art from the 
following figures, description, and claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present inven- 
tion and the advantages thereof, reference is now made to 
the following description taken in conjunction with the 
accompanying drawings, wherein like reference numerals 
1 represent like parts, in which: 

FIG. 1 illustrates a block diagram of an information 
service provider network; 

FIG. 2 illustrates a flow chart showing the process of 
routing information in the internet sendee provider network; 

FIG. 3 illustrates a block diagram of a content gateway in 
the information service provider network; 

FIG. 4 illustrates a functional block diagram of the 
information service provider network; 

FIG. 5 illustrates an operational flow diagram of the 
information service provider network; 

FIG. 6 illustrates an example flow of request processing 
performed by the content gateway; 

FIG. 7 illustrates a multiple internet service provider 
network; 

FIG. 8 illustrates a billing model within the multiple 
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FIG. 9 i 



policies within a request forwarded across Ihe network. 



Content Gateway 

FIG. 1 is a block diagram of a request content processing 
network 10. Request content processing network 10 includes 

one 01 more information service providers 12 that provide 

information from a content provider 14 in response to 
requests from one or more client terminals 16. Information 
service provider 12 includes one or more content gateways 
18 that interface client terminals 16 with content providers 
14 in response to policies provided by a content gateway 
policy manager 26. Content gateways 18 distribute infor- 
mation from content providers 14 either directly or through 
content delivery nodes 22 to client terminals 16 according to 
content gateway policy manager 26. Content gateway policy 
manager 26 is a management node in information service 
provider 12 that serves as a repository for content policies 
and communicates with content gateways 18 to distribute 
content policies within information service provider 12 and 
exchange policies with other content gateway policy man- 
agers in other information service providers. 

Content gateway 18 provides a routing and processing 
function at an edge of request content processing network 
10. Content gateway 18 represents a point of presence so 
that client terminals 16 can obtain information from content 
provider 14. At the client terminal end, content gateway 18 
may connect to access routers fed by local area networks 
with multiple client terminals 16. Also, wireless client 
terminals may be attached to content gateway 18 through 
various wireless controllers. Content gateway 18 provides a 
value added service at information service provider 12 
points of presence for subscribed content providers 14. 
Content gateway 18 selects the appropriate server at content 
provider 14 that can deliver the content with an acceptable 
Content gateway 18 also services requests 
nore than one information service provider 12. 
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A content provider 14 may have contracts with more than 
one information service provider 12 or different information 
service providers 12 may have contracts with each other to 
facilitate one information service provider 12 honoring 
service level agreements for another information service 5 
provider 12 subscribed content provider 14. Content gate- 
way 18 ensures that requests are executed according to 
policies that maximize performance for the subscribed con- 
tent provider 14 and yet do not violate the collection of 
contracts that are in effect. 10 

Content gateway 18 intercepts request that are candidates 
for content processing, elassiiies requests by examining the 
content of the request, makes routing decisions based on the 
content of the request, and determines an appropriate content 
provider 14 server location to satisfy the request including 15 
location of servers in the best proximity to the client terminal 
16. Content gateway 18 establishes a connection with the 
selected destination server or other content gateways having 
the characteristics specified by the associated classification 
policy and forwards the request over the allocated connec- 20 
tion. Content gateway 18 participates in a policy distribution 
network to receive and install content policies and supports 
content peering in order to direct requests to content gate- 
ways or content delivery nodes in other information service 
providers 12. Content gateway IS also collects hilling and :5 
accounting records that capture volume of content processed 
by content provider, home and affiliate information service 
providers 12, and content policy rule. 

To avoid obtaining information from a far away, over- 
loaded, or redirected server, content gateway 18 learns about 30 
the distribution of information so that a request can be 
directed to a server that can deliver the requested informa- 
tion in a direct and efficient manner. In some cases, the 
request may be directed to a local content delivery node, 
proxy cache, or replication server that contains a replica of 35 
the information requested. Content gateway 18 extends the 
routing concept to include the content of the request. 

FIG. 2 is a flow chart illustrating steps in the process of 
routing information in information service provider 12. As 
illustrated in FIG. 2, client terminal 16 located in Phoenix 40 
makes a request to www.lionda.com. Initially, a domain 
name server request is issued from client terminal 16 to 
determine if the associated domain name merits enhanced 
propagation through request content processing network 10. 
If the domain name is subscribed for content gateway 45 
services, the IP address of content gateway 18 is returned. 
Subsequently, client terminal 16 makes a connection with 
content gateway 18 and sends the request accordingly. 
Content gateway 18 intercepts the request and parses the 
uniform resource locator and the HTTP headers. 50 

At this point, the objective of content gateway 18 is to 
locate the "best" server and network connection for deliv- 
ering data to client terminal 16, i.e., the server that will 
deliver the content the fastest with the required security 
protection. Determining the best server depends on various 55 
factors including whether the internet service provider 
implements a content delivering nodes, whether the content 
requested is static or dynamic, whether the content is rep- 
licated in different data centers or at the content delivery 
nodes, and which of the eligible servers are most heavily 60 
loaded. 

In the example illustrated in FIG. 2, information service 
provider 12 uses content delivery nodes 22 to propagate 
static content for subscribed content providers 14 closer to 
client terminals 16. Content delivery nodes 22 cache static 65 
content (potentially on demand) for all domains for Honda. 
Content gateway 18 provides a domain name system proxy 



function that guarantees location of content delivery nodes 
22 or content provider 14 servers close to client terminal 16. 
This would also be true if there exists a local domain name 
server near client terminal 16. Some information service 
providers 12 may also centralize their domain name system 
servers for better manageability. 

In the example illustrated in FIG. 2, if the content provider 
14 servers for Honda were located in New York and content 
gateway 18 did not exist, information service provider 12 
may locate content delivery node 22 with address 
50.20.30.5, which is a substantial distance from client ter- 
minal 16 in Phoenix. In the example illustrated in FIG. 2, 
content delivery node 22 with address 50.20.30.2, located in 
I os Angeles, is returned using content gatew ay 18. Once the 
IP address of a content delivery node 22 is determined, 
content gateway 18 is able to recall this information for a 
prescribed time. 

In the example illustrated in FIG. 2, it is presumed that a 
starting web page is retrieved from www.honda.com. This 
page can be retrieved from any data center and cached at all 
the content delivery nodes 22. Client terminal 16 issues a 
domain name system request to content gateway 18 and the 
IP address of the deliver) node 50.20.30.2 is eventually 
returned to content gateway 18. With this in place, content 
gateway 18 may now fill in the server field for the content 
class that matches www.honda.com. Content gateway 18 
returns its IP address 70. 70. NO. 1 as the initial domain name 
system response. Client terminal 16 connects to content 
gateway 18 and forwards the request. Content gateway 18 
connects to content delivery node 22 with address 
50.20.30.2, receives the page for www.honda.com, and 
returns it to client terminal 16. After the www.honda.com 
page is displayed, client terminal 16 may trigger a request 
for a car image such as acura.jpeg at cars.honda.com. Again, 
the domain name system request from client terminal 16 is 
intercepted by content gateway 18 and the IP address of 
content gateway 18 is returned to client terminal 16. At this 
point, client terminal 16 connects to content gateway 18 and 
sends the "GET" request for cars.honda.com/images/acura. 
jpeg. At this point, content gateway 18 consults an associ- 
ated policy for the URL and a content gateway directory and 
recognizes the server IP address is present. This is a conse- 
quence of a policy that indicates static hypertext transfer 
mark-up language (HTML) and JPEG objects reside on the 
same content server. Consequently, content gateway 18 may 
connect immediately to the content delivery node 22 with 
address 50.20.30.2 to retrieve acura.jpeg. 

Because content gateway 18 parses the URL request, it 
may immediately recognize whether or not the response is 
cacheable. As illustrated in FIG. 2, a dynamic request 
"GET" cars.honda.com/cgibin/price.exe is issued. Content 
gateway 18 consults the content gateway directory and 
routes the request to the specified server which happens to 
be the origin server. The origin IP address may be configured 
as part of the content policy or learned indirectly from 
previous domain name server query processing operations. 

An important advantage of content gateway 18 is essen- 
tially control. This is because different traffic policies and 
differentiated services may be signaled to content gateway 
18 causing, for example, packets between content gateway 
18 and the origin server to receive high priority. Content 
gateway 18 implements much of the content inspection logic 
and performs additional logic so that most of the traffic is 
routed at the layer 2/layer 3 level. Alternatively, if the 
internet service provider does not support content delivery 
nodes 22, content gateway 18 may provide a large improve- 
ment in performance since redirection overhead may be 
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avoided completely. For example, if in FIG. 2, no content provide redundancy, fail over characteristics, and extra 
delivery nodes 22 are present and information resources capacity for request content processing network 10. 
reside only at the New York content provider 14, then the Content gateway processor 30 communicates with con- 
request for cars.honda.com/images/acura.jpeg may initially tent gateway router 28 and with any information source in 
be routed to 10.20.30.40. The request would then subse- 5 request content processing network 10 in order to retrieve 
quently be redirected to 10.10.10.11. Content gateway 18 information associated with the request. Additionally, con- 
may dynamically learn or be configured to know the origin tent gateway processor 30 may communicate with a series of 
servers for all of the content classes. In addition, as data is additional processors which all may communicate with 
duplicated over several content providers 14, relatively content gateway router 28. Content gateway processor 30 
infrequent probes may be sent out by content gateway 18 to 10 may receive information from an application content data 
determine patterns based on preferred choices. This may be provider 14 or content delivery node 22 within request 
particularly significant in the presence of transparent caches. content processing network 10, or from any other data 
As illustrated in FIG. 2, another important advantage of source in response to a request that is provided at client 
the present invention is that requests meriting standard terminal 16 and communicated through content gateway 
processing are not effected by the subscribed enhanced is router 28. 

processing capabilities. Connections for a request that are In one embodiment of the present invention, the internet 
not for subscribed content providers 14 are not terminated at protocol (IP) address of content gateway processor 30 is 
content gateway 18, and therefore, are not subject to any communicated to content gateway router 28 in response to 
content routing overhead. Connections for requests sent to a request from client terminal 16. The communication of the 
subscribed content providers 14 are terminated at content 20 request through the network is facilitated by a content 
gateway 18 so that the request content may be classified. gateway directory 32 within content gateway processor 30. 
Content gateway 18 is intended to accelerate both static Appropriate content policy is kept in content gateway direc- 
objects (e.g.. graphics, HTML text files, etc.) and dynamic tory 32 in a memory space of the content gateway processor 
objects that are generated by an executable program. While 30. Content gateway directory 32 is used to resolve the 
it is possible that dynamic objects may be retrieved from 25 requests to the best server location. Content gateway direc- 
mtilliplc locations, it is less likely for this to occur because tory 32 includes a content class that consists of a template 
their creation (via program execution) is frequently depen- and a set of rules for pattern matching the uniform resource 
dent on a non-replicated database. locator (URL) of the request and, in accordance with one 
FIG. 3 shows a block diagram of content gateway 18. embodiment, the hyper text transfer protocol (II TIT) head- 
Content gateway 18 is a composite node that includes a 30 ers. If a match is found, the transport rules are used to 
content gateway router 28 and one or more content gateway establish a connection to a content location. The transport 
processors 30. Content gateway router 28 is an edge-router rules consist of a set of differentiated service (or quality of 
that operates to direct a request within request content service) flags as defined by the proprietary values, a policy 
processing network 10 toward a destination. While based routing identifier, and a set of rules for determining the 
described as an edge-router, the present invention contem- 35 optimal server (defined as producing the quickest response 
plates that content gateway router 28 may be any other time to the request with the required security protection) to 
suitable device capable of directing information in request deliver the content associated with the request. These rules 
content processing network 10. Content gateway router 28 may be a list of server IP addresses and/or an indication that 
serves as a point of presence within information service an ADNS server is to be invoked to resolve the request 
provider 12. Content gateway router 28 contains the inter- 40 domain name. 

faces that attach content gateway 18 to the backbone of Content gateway directory 32 codifies a policy for content 

request content processing network 10 and also includes the based routing. Content gateway directory 32 includes a 

connections that aggregate client traffic. Content gateway classification policy and a processing policy. The classifi- 

router 28 may be connected to local area networks that cation policy defines the pattern or template used to match 

attach to client terminals 16, enterprise servers, or server 45 the domain name and additional content of the request from 

farms. Content gateway router 28 may receive a request client terminal 16. If all parts of the request match a pattern 

from a browser associated with client terminal 16 and or template in the classification policy, then the request is 

communicate the request to a pathway leading to its proper classified for processing by an associated processing policy, 

destination. Content gateway router 28 is capable of direct- The processing policy includes the processing actions for the 

ing a series of requests that it receives from client terminal 50 request to include identification of a source of information to 

16. The routing of the request received by content gateway satisfy the request. Appendix A shows an example configu- 

router 28 may be based on information carried by the ration of content gateway directory 32. 

request. Content gateway router 28 transmits information, An important function of content gateway 18 is to avoid 

via packets in a transmission-controlled protocol (TCP) penalizing traffic that is not subject to content routing where 

format. Where appropriate, content gateway router 28 55 content provider 14 has not subscribed to such service, 

directs a request to an appropriate content gateway processor Non-subscription traffic is routed directly by content gate- 

30. way router 28, bypassing content gateway processor 30, 

Content gateway processor 30 includes a separate pro- toward a destination content provider 14 with no extra 

cessing system optimized for processing content or other overhead due to the presence of the content routing capa- 

suitable data in request content processing network 10. 60 bility. The processing of requests during content aware 

Content gateway processor 30 is the processing system that processing thus involves two steps. First, by inspecting DNS 

generally executes content routing L7 functions. Content queries, the request traffic is qualified by domain name to 

gateway processor 30 is connected to content gateway router determine if it should be routed to a content gateway 

28 via a fast high capacity connection (e.g., gigabit Ether- processor 30. Second, if the request traffic qualifies for 

net). Content gateway processor 30 may also be installed as 65 content processing, it is routed to an appropriate content 

a card within content gateway router 28. In general, there gateway processor 30 where the content of the request is 

may be more than one content gateway processor 30 to processed. 
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In processing a request in request content processing 
network 10, content gateway processor 30 cooperates with 
content gateway policy manager 26. Content gateway policy 
manager 26 is introduced into the content gateway archi- 
tecture in order to define a policy server for the distribution 5 
of classification and processing policies u> additional content 
gateways 18. When content gateway 18 is initiated, it may 
register with an associated content gateway policy manager 
26. A policy distribution point responsible tor distributing 
policies to other network elements is connected to content in 
gateway policy manager 26 and may send policy updates to 
other content gateways 18 and content gateway policy 
managers 26 as appropriate. Content gateway policy man- 
ager 26 also facilitates the distribution of content policies to 
additional content gateway policy managers 26. Content is 
gateway policy manager 26 includes a Policy Distribution 
Point (PDP) 40 to handle distribution of policies throughout 
request content processing network 10. Content gateway 
router 28 includes a Policy Enforcement Point 42 that 
receives policy from PDP 40 for installation and subsequent 20 
enforcement. Content gateway policy manager 26 also sup- 
ports the exchange of policies with other affiliated informa- 
tion service providers 12. This allows, for example, repli- 
cated content in one information service provider 12 
environment to be accessed by a content gateway 18 in 25 
another information service provider 12 environment. Policy 
exchanges between information service providers 12 is 
based on service level agreements among the information 
service providers 12 and content providers 14 with the 
common open policy service (COPS) protocol (or equivalent 30 
protocols including XMI.) being used lor 

Content gateway policy manager 26 may 
with its peers to distribute policy information for multiple 
information service providers 12 to the edges of request 
content processing network 10 so that requests can be routed 35 
directly to the optimal server or servers. This feature elimi- 
nates the need for content inspection in the core of request 
content processing network 10 and the associated overhead 
that would significantly reduce traffic throughput. Content 
gateway policy manager 26 also contains a persistent reposi- 40 
tory for large sets of content policy data for its own 
information service provider 12 and affiliated information 
service providers 12 resulting from policy exchanges. This 
repository can contain more content policy data than could 
be contained in the real memory stored in content gateway 45 
18. Using content gateway policy manager 26, content 
policy can be downloaded to content gateway 18 on demand 
using a policy replacement algorithm for cases where the 
content gateway memory is full. Internet service provider 
policy distribution is subject to policies that dictate authen- ?" 
tication, authorization, and accounting requirements, and 
transport policy negotiation. 

Domain Name Qualification 

FIG. 4 is a block diagram of another request content 55 
processing network 10. Request content processing network 
10 includes a customer network 13, an information service 
provider 12, and a content provider 14. Customer network 
13 includes one or more client terminals 16 and a local 
domain name server 20. Client terminals 16 send out queries 60 
for processing by local domain name server 20. Client 
terminals 16 may be individual users, application service 
providers, other information service providers, enterprises 
that pay information service providers for networking ser- 
vices, or any entity that subscribes to information service 65 
provider services. If the local domain name server 20 has an 
entry for the request, the entry is forwarded to the requesting 



client terminal 16. If the local domain name server 20 does 
not have an entry for the request, the request is forwarded to 
information service provider 12 for processing. Information 
service provider 12 will return an Internet Protocol (IP) 
address to the client through local domain name server 20 in 
order to establish a connection with a server identified by the 
IP address in order to process the content of the request. 
Local domain name server 20 may include a database which 
can be updated upon the return of the IP address from 
information service prov ider 12 so that subsequent requests 
for the same domain name can be initially handled directly 
by local domain name server 20. 

Information service provider 12 includes a content gate- 
way 18, an authoritative domain name server 24, and a 
content gateway policy manager 26. Content gateway 18 is 
a composite node that includes a content gateway router 28 
and one or more content gateway processors 30. Content 
gateway router 28 is a network edge router that contains 
interfaces to attach content gateway 18 to the backbone 
network and the connections that aggregate customer traffic. 
Content gateway processors 30 provide the processing sys- 
tem to execute content routing functions. Content gateway 
policy manager 26 communicates with peer managers to 
distribute content policy information to content gateways 18 
for multiple information service providers 12 to the edges of 
the network so that requests can be routed directly to the best 
server using the appropriate network transmission service. 
Content policy may be downloaded to content gateways 18 
from content gateway policy manager 26. Authoritative 
domain name server 24 provides appropriate IP addresses to 
handle requests when neither local domain name server 20 
nor content gateway 18 have entries for those requests. 
Local domain name server 20 and authoritative domain 
name server 24 are TCP/IP architected distributed servers 
that resolve an Internet domain name to an Internet IP 
address and an IP address to a domain name. 

FIG. 5 shows an example operation of content gateway 
18. Initially, a browser in client terminal 16 issues either a 
request for information or a domain name server query along 
path A for some domain. Individual customer terminals 
directly or indirectly reference local domain name server 20 
supplied by their information service provider 12. Though 
shown outside of information service provider 12, client 
terminals 16 may reference a local or authoritative domain 
name server 24 within information service provider 12 
depending on the configuration of the network. In this 
situation, a domain name server query is generated and 
issued by client terminal 16. Thus, for some networks, there 
may not be a local domain name server 20 outside of 
information service provider 12. Normally, local domain 
name server 20 may not include an entry to handle the 
request from client terminal 16 but does contain resource 
records for resources outside of its domain that reference 
authoritative domain name server 24. In such a situation, a 
domain name server query is generated from the request and 
routed along path B towards authoritative domain name 
server 24 in information service provider 12. Without the 
presence of local domain name server 20, the query goes 
directly from client terminal 16 to information service 
provider 12 along path B according to client terminal 16 
being configured to reference a local or authoritative domain 

Content gateway 18 includes an intercept function within 
content gateway router 28 to capture queries to authoritative 
domain name server 24. Content gateway router 28 includes 
a valid domain name table 34 that references a domain name 
with an IP address of an associated content gateway pro- 
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cessor 30 that will perform content routing of the query. if present, in response to the request from client terminal 16. 

When content gateway router 28 receives a domain name If there is a local domain name server 20 present, it is 

server query from path B, the valid domain name table 34 is assumed that it does not have an entry for the domain name 

searched for the domain name of the query. If the domain www.honda.com and so forwards the domain name server 

name of the query is found in valid domain name table 34, 5 query to authoritative domain name server 24. Content 

the IP address of the associated content gateway processor gateway router 28 intercepts the query (1) and searches valid 

30 is returned as the domain name server response to the domain name table (VDNT) 34 for a matching domain 

query along path C. The IP address of the associated content name. If there is a match, the domain name is qualified and 

gateway processor is returned to client terminal 16 along becomes a candidate for content routing. If the domain name 

path D through local domain name server 20 if present. 10 is not qualified, content provider 14 has not subscribed to 

Local domain name server 20 may update its database with request acceleration with information service provider 12 

the IP address of the associated content gateway processor and an IP address of an appropriate server is obtained as 

30 so that subsequent requests for that domain name may be described earlier to establish the connection with client 

handled locally in customer network 13 without repeating terminal 16 in order to provide the appropriate content, 

the above procedure. is Content gateway router 28 returns an IP address (2) of an 

Upon receiving the IP address of the associated content associated content gateway processor 30 from valid domain 

gateway processor 30, client terminal 16 establishes a con- name table 34 so that the associated content gateway pro- 

nection along path H with content gateway processor 30 in cessor 30 can serve as a proxy for client terminal 16 to 

order to execute the request. Content gateway processor 30 perform content routing of the request. Client terminal 16 

may connect to a server 36 of content provider 14 along path 20 then establishes a connection (3) with the associated content 

I according to the content policy for the domain name. gateway processor 30 in order to execute the request. 

Content gateway processor 30 acts as a proxy for client Upon establishing the connection, client terminal 16 

terminal 16. Content gateway processor 30 will select the provides the request (4) to the appropriate content gateway 

server that can deliver the requested content in an efficient processor 30. Content gateway processor 30 parses the 

manner within the policy guidelines of the domain as :s Uniform Resource Locator (URL) of the request for classi- 

subscribed to by content provider 14. fication. ( 'ontent gateway processor 30 determines whether 

If the valid domain name table 34 does not find an IP there is a policy for the classification of the request. If so, for 

address match for the domain name of the query, the domain example the request matches the class cars/*.jpeg, content 

name server query is routed toward the intended authorita- gateway processor 30 issues setup instructions (5) to route 

live domain name server 24. Authoritative domain name 30 all packets of this How to the appropriate outbound interface 

server 24 returns an IP address for server 36 of content in accordance with the policy for subsequent processing by 

provider 14 that is routed back to client terminal 16. Client server 36 of content provider 14. Content gateway processor 

terminal 16 establishes a connection directly with server 36 30 receives the appropriate content (6) from server 36 and 

along paths Hand I that flow through content gateway router forwards it to client terminal 16. If any modification of 

2H without passing through any content gateway processor 35 packet data is desired, content gateway processor 30 remains 

30. as a termination point, or proxy, for the duration of the 

Since valid domain name table 34 is relatively small and connection. If no modifications of the packets are necessary, 

is not designed to hold every possible domain name that has the connection may be unproxied to have a direct connection 

an associated content policy for execution by a content between client terminal 16 and server 36 for improved 

gateway processor 30, there may be a content policy for a 40 efficiency of the traffic during the remainder of the connec- 

domain name within content gateway policy manager 26. In tion. 

parallel, the domain name server query is also forwarded to Though the domain name may be qualified, the request 
content gateway policy manager 26 along path D. Content may not have a matching classification in content gateway 
gateway policy manager 26 determines if there is a content processor 30. In such a situation, there is no policy for 
policy associated with the query. Content gateway policy 45 request acceleration. Content gateway processor uses a 
manager 26 searches its policy database for policy informa- domain name server proxy 38 to obtain a valid IP address of 
tion. If no policy exists, then no action is taken. If a policy a server for the domain name. The domain name server 
exists for the domain, the policy is provided to content proxy provides a query to authoritative domain name server 
gateway router 28 along path E. Content gateway router 28 24 over path J. Authoritative domain name server 24 pro- 
selects a content gateway processor for the domain, inserts 50 vides an IP address of an appropriate server to content 
an entry in valid domain name table 34 including the domain gateway processor 30 over path K. Content gateway pro- 
name and the IP address of the selected content gateway cessor establishes a connection with the appropriate server 
processor 30, and propagates the policy information to the to obtain the requested content. Subsequently, content gate- 
selected content gateway processor 30. The current request way processor 30 may unproxy the connection so that the 
being processed will result in a direct connection between 55 remainder of the traffic may be routed directly between 
client terminal 16 and server 36. If a policy update is client terminal 16 and the appropriate server, 
received from content gateway policy manager 26 for this When a domain name is qualified for content processing, 
domain, then subsequent requests for this domian will be content gateway processor 308 terminates the connection 
processed according to the newly installed policy. Policy with client terminal 16 to receive the request. Using content 
updates and request processing is performed asynchronously 60 gateway directory 32, content gateway processor 30 
in parallel so that user request traffic throughput is not attempts to classify the request by parsing the URL and 
degraded due to policy information update processing. HTTP headers into its constituent parts, such as application 
FIG. 6 is an example flow of request processing per- (e.g., http), domain name (e.g., www.honda.com), and object 
formed by content gateway 18. The request used in the (e.g., images/accord.jpeg). The parsed result is pattern 
example is http://www.honda.com/cars/accord.jpeg. A 65 matched against corresponding fields in content gateway 
domain name server query is generated from the request and directory 32. The matching process proceeds from the most 
sent by client terminal 16, or local domain name server 20 specific to the most general object class until either a match 
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is found or the process fails. If the request is classified, then 
content gateway processor 30 establishes a connection with 
the server identified by content gateway directory 32 using 
the transport policy and server address specified by the 
processing policy. 

In order to ensure that all server responses are returned to 
content gateway processor 30, the IP address and port 
number (ip:port) of client terminal 16 is translated to one 
that identifies content gateway processor 30. Since traffic for 
many client terminals 16 may be flowing through content 
gateway processor 30, a client network address translation 
pool may be used l ■> assign a unique source ip:port per client 
terminal 16 for outbound packets. On inbound packets, this 
address is seen as the destination ip:port. This address is 
used to locate the client connection so that the original client 
ip:port can be restored as the destination address to forward 
the packet to client terminal 16. 

Some content providers 14 require the source IP address 
of client terminal 16 be preserved at their servers for logging 
and accounting purposes. The translation performed by the 
client network address translation pool would restrict such a 
preservation capability. To solve this, the client ip:port may 
be inserted by content gateway processor 30 as a TCP option 
in the TCP/IP header. Since this option would be ignored by 
the TCP/IP stack at the receiving server, a translation would 
be performed prior to the packet reaching the server. The 
translation may be performed by a server load balancer 
where the client ip:port is extracted from the TCP/IP option 
field, the source ip:port (the address inserted by content 
gateway processor 30 through use of the client network 
address translation pool) is saved, and inserting the client 
ip:port in place of the source ip:port before forwarding the 
packet to the server. For outbound flows, the load balancer 
would reverse the process by replacing the client ip:port 
with the saved source ip:port so that the packet would be 
properly sent to content gateway processor 30. 

It is possible that information to satisfy related requests 
may not be located at the same server. If a request is received 
from client terminal 16 and its classification results in a 
destination server different than the current server connec- 
tion, then a new connection to the new server is established. 
Rather than immediately de-allocating the current server 
connection, content gateway processor 30 maintains a con- 
nection list for client terminal 16. When a request is received 
that references a different server, content gateway processor 
30 will save the current connection in the connection list. If 
a connection to the requested server exists in the connection 
list, content gateway processor 30 will re-establish the 
connection for client terminal 16 to the requested server 
according to the saved connection. When the connection list 
becomes full, the current connection may be saved by 
removing the least recently used connection in the connec- 
tion list. In this manner, connections may be quickly re- 
established in anticipation of additional requests from the 
same client terminal 16 to the same server without the need 
to establish the connection from scratch. 

Each entry in content gateway directory 32 relates to a set 
of objects. However, each request deals with a single object, 
such as acura.jpeg. When the best location to satisfy a 
request is determined, a principle of generalization is used to 
assert that this location is also good for satisfying requests 
with objects of a similar type since similar objects are 
typically stored at the same location. For example, from 
FIG. 2, if the best location for retrieving www.honda.com/ 
cars/accord.jpeg is the New York location f 0.10.10.11, it is 
also assumed to be the best location to retrieve www.hon- 
da.com/cars/acura.jpeg. The principle of generalization 
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allows for server addresses to be assigned for an entire 
request class, such as www.honda.com/cars/* .jpeg. 

The processing policy for an entry in content gateway 
directory 32 may specify a list of server addresses that can 

5 satisfy the request. If more than one address is specified, it 
is presumed that the set of objects identified by the classi- 
fication policy exists at all of the locations. The optimal 
server may vary according to the location of content gate- 
way 18. When the processing policy is installed, all servers 

10 are probed so that the server address list is ordered properly. 
Probes may be executed periodically from content gateway 
processor 30 to dynamically improve the ability to find the 
best server or cache of information. Content gateway pro- 
cessor 30 dynamically learns of best server locations 

15 through the use of these probes, discovery of other content 
delivery nodes for a given class, monitoring of redirect 
flows, and observance of response flows. 

Quality Of Service Policy 

20 There are two classes of policies relevant to content 
gateway 18, quality of service policies that are downloaded 
to content gateway router 28 and content policies distributed 
to content gateway processors 30. Content gateway policy 
manager 26 is used to distribute content policies to content 

25 gateway processors 30 and a separate policy server may be 
used to distribute quality of service policies to content 
gateway routers 28. Content gateway policy manager 26 
performs a distribution role using a policy distribution point 
to provide the content policies to content gateways 18. 

30 Content gateway router 28 performs an enforcement role 
using a policy enforcement point to implement content 
policies provided by content policy manager 26. 

FIG. 7 is a block diagram illustrating multiple internet 
service provider networks (ISP A, ISP B, ISP C) and a set of 

35 policy managers 26a, 26i>, and 26c. For purposes of 
example, internet service providers A, B, and C have been 
illustrated with different agreements or contracts 27a, 27b, 
and 27c with an exemplary application service or content 
provider 14 LFM.com. Each content gateway 18a-g has 

40 been configured to point to its respective policy manager. 
Policy managers 26«, 26b, and 26c implement a COPS 
content policy distribution point. 

Initially, each internet service provider's content policy 
data is installed on a respective policy manager 26a, 26b, or 

45 26c from a policy repository. These policy data are con- 
structed in accordance with agreements 27a, 21b, and 27c 
with the subscribed content providers (such as application 
service or content provider 14 LFM.com). Each policy 
manager 26a, 26£>, and 26c is explicitly configured to 

50 connect to each other for internet service providers for 
which there is a contractual agreement to share content 
policies. For each foreign internet service provider it has a 
contract with, the policy manager configures the IP address 
and the security features of the peer policy manager in 

55 accordance with the policy service distribution protocol 
(e.g., COPS). 

Policy exchange between policy managers 26a, 26b, and 
26c is generally unidirectional; if the agreement is reciprocal 
then there are two unidirectional exchanges, one in each 

6u direction. Policy distribution is performed pairwise, i.e., a 
policy received by policy manager 26Z> from policy manager 
26a is not automatically propagated to policy manager 26c 
because policy manager 26b does not know the contractual 
agreement between internet service providers A and C. Thus, 

65 each of policy managers 26a, 26b, and 26c assume the role 
of policy distribution point or policy enforcement point by 
communicating with another policy manager, depending on 
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whether it is the distributor or recipient of the policy, 
respectively. Content policy for individual domains can be 
downloaded on demand as requests are received from con- 
tent gateways I8a-g. Alternatively, each of content gate- 
ways 18«-g can request that all policies arc downloaded in 
a hatch-like mode (e.g., during startup). 

As illustrated in FIG. 7, the policy information for appli- 
cation service or content provider 14, (LFM.com) and each 
internet service provider A, B, and C is shown in agreements 
27a, 27b, and 27c. The policy exchange possibilities 
between internet service providers A, B, and C for LFM.com 
are depicted by the double-headed arrows between the 
policy managers 26a, 26b, and 26c. Generally this would 
result in a policy merge of all the internet service provider 
policies. Since the initial policies for internet service pro- 
vider A and internet service provider C are a subset of the 
policies of internet service provider B, the end result is that 
all policy managers connected to internet service provider B 
in a given network would contain the policies of internet 
service provider B. System caches 22a and 22b in internet 
service provider B are now known to internet service 
providers A and C. This enables, for example, a joint 
photographies experts group (JPEG) image request gener- 
ated at a client terminal 1 ( J (requiring additional processing) 
to the LFM.com server to be immediately directed to the 
nearest content delivery node in internet service provider B. 

In general, transport policy merges are resolved according 
to contracts between internet service providers A, B, and C 
and application service provider 23. For example, as illus- 
trated in FIG. 7, if internet service provider B offers a quality 
of service equal to level three, and internet service provider 
A contracted with LFM.com for a quality of service having 
a level of two, internet service provider A may use a quality 
of service of level three if internet service provider B has an 
agreement with internet service provider A or LFM.com 14 
to promote the quality of service identified. Such contracts 
would presumably have commensurate billing implications 
among internet service providers and content providers to 
recover the incurred costs. 

FIG. 8 is a block diagram illustrating a billing model in 
which a set of content gateways 18a, 186, and 18c are 
positioned on the edge of ISP networks in accordance with 
one embodiment of the present invention. As illustrated in 
FIG. 8, each internet service provider A, B, and C has its 
own associated policy manager 26a, 26b, and 26c that 
rcllccls the services subscribed to by different internet 
service provider customers (e.g., content providers or other 
internet service providers, enterprises, etc.) that are embod- 
ied in a set of agreements 27d, 27e, and 27/. Each internet 
service provider A, B, and C also has its own billing 
applications that collect usage statistics for all of the cus- 
tomers subscribed to its devices. In the illustrated embodi- 
ment, LFM.com has subscribed to a silver service for 
internet service providers A and C and a premium service for 
internet service provider B that includes additional data 
replication and caching capacity via cache 22a. As shown in 
FIG. 8, the quality of service changes as data flows across 
the internet service provider networks to application service 
or content provider 14 LFM.com. 

The content gateway allows internet service providers to 
provide value-added services to the internet service provider 
customer. As such, the billing management requirement is to 
provide a mechanism allowing the internet service provider 
to charge their customers where the service is being added. 
Billing information within system 10 may be collected at the 
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edge of the network on behalf of all the internet service 
providers involved in the flow of information. To achieve 
this end, each policy should contain a list of internet service 
provider identifiers so that information collected for that 

5 flow may be associated with each internet service provider. 
The content gateway may collect the following flow infor- 
mation: the service provider, the URL that was matched by 
application of the class maps, the source IP address, the 
internet service provider identifiers, the number of bytes and 
packets traversed on that flow, a time stamp for the start and 
end of the flow, etc. This information may be stored or sent 
periodically to a pre-defined repository for additional pro- 
cessing of this information. 

IS As illustrated in FIG. 8, when the request for information 
arrives at content gateway 18a, it is routed to cache 22 (via 
content gateway 18fc) instead of the selected destination 
(LFM.com) server (via content gateway 18c). This reflects a 
quality of service of level two embodied in agreement 27d. 

20 Content gateway 18a may enable different internet service 
providers to offer levels of request acceleration based on a 
corresponding level of service subscribed to. As illustrated 
in FIG. 8, content gateways 18a, 18fc, and 18c also provide 
the collection of performance statistics (e.g., byte/packet, 

25 counts, data rate, etc.) for billing, service level agreement 
(SLA) validation, and network tuning purposes. A set of 
invoicing records lor bills 31a, 31/', and 3L for an associ- 
ated application service or content provider 14 LFM.com are 
also generated by content gateways 18a, 18/), and 18c. 

To implement the quality of service policy, content gate- 
way 18 modifies the request according to the quality of 
service policy from content gateway policy manager 26 or 
some oilier policy manager that controls quality of service 

35 policies. Once the connection is established to the identified 
server, content gateway 18 dynamically modifies packets 
received from client terminal 16 with a quality of service 
value according to the content policy for the request before 
the packet is forwarded to the identified server. This quality 

40 of service value will reflect a different class of service than 
that provided by the information service provider 12. The 
quality of service component of content gateway 18 lever- 
ages L2/L3 quality of service features to provide differen- 
tiated service to qualified HTTP requests. This may include 
utilizing class based weighted fair queuing to allow speci- 
fying an exact amount of bandwidth to be allocated for a 
specific class of traffic tied to defined queue limits and drop 

As discussed above, HTTP requests are classified at 

50 content gateway IS according to their subscription policy. If 
the HTTP request is qualified for accelerated service, then a 
quality of service value is assigned to that traffic by selling 
the Differentiated Services (diffserv) field (formerly called 
the type-of-service byte) in the IP header of the request. 

55 Requests that do not qualify for accelerated service fall into 
a best efforts class. The diffserv field is used to signal other 
nodes in network 10 to provide appropriate service for the 
requested quality of service class. 

FIG. 9 shows the diffserv field of the IP header. The 

60 diffserv field occupies the first six bits of the IP header TOS 
byte. DSCP values placed into the diffserv field may repre- 
sent an expedited forwarding class, an assured forwarding 
class, and a best efforts class. The DSCP value may also 
indicate a drop precedence. Table 1 shows examples of 

65 possible quality of service policies and Table 2 shows how 
the quality of service policies relate to requests in content 
gateway directory 32. 
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TABLE 1 
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HTTP *.html,*.jpeg 
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the art and may be made herein without departing from the 
spirit and scope of the present invention as defined by the 
following claims. 



CGD DEFINITION 



Classification Policy 



Template definition for classifying 

URL requests. The fields of this 

part are described in "COD 

( 'lassil'.calion Policy". 

This part of a CGD entry contains 

classification policy. The fields 
of this part are described in "CGD 
Pioccssing Policy". 



CGD CLASSIFICATION POLICY 
Field Name Field Description 



Differentiated services are realized by mapping the diff- 
serv field of the IP packet header to a particular forwarding 
treatment or per hop behavior at each node in network 10 
along the request's path. Per hob behavior is implemented 3 
by employing a range of queue service and/or queue man- 
agement disciplines on a network node's output queue. Such 
disciplines include weighted round robin queue servicing, 
drop preference queue management, bandwidth allocation, 
and scheduling priority. Additionally, each node may also 3 
provide policing, metering, shaping, out of profile treatment, 
802. lp packet marking, and WRED functionality. Other 
considerations include mapping to multiple path MPLs to 
take on faster routes to reach the endpoint. Mapping may 
vary from node to node. Providing packcl forwarding pri- 
ority and bandwidth to requests that qualify for accelerated 
service guarantees belter performance compared to requests 
that have not been subscribed for such treatment. 

Thus, it is apparent that there has been provided, in 4 
accordance with the present invention, a system and method 
for processing a request for information in a network that 
satisfies the advantages set forth above. Although an 
embodiment has been illustrated and described in detail, it 
should be understood that various changes, substitutions, 5 
and alterations can be made herein. For example, although 
the present system has been described with reference to an 
internet, other communication elements such as wireless 
s and desktop applications using an intranet 
t may utilize the disclosed system while still 
realizing the present invention. In addition, although the 
VDNT (34) and the ADNS (24) have been described in 
association with a router, these elements may be placed 
anywhere or communicate with any element in the network , 
in order to effect quality of service routing while still 
realizing the present invention. Also, although the quality of 
service discussed relates to an agreement between an inter- 
net service provider and a content, service, or application 
service provider, this agreement could be between any two 6 
persons or organizations associated with the network. Other 
examples may be readily ascertainable by those skilled in 



a URL. The 
Jtc. will he 



a prefix or suffix to individual names 
within the URL or in place of a name. A 
list of the form {a, b, . . . } following a 
v. iklcai J limits the value ol the 
wildcard to those elements in the list. 
For example, 

projects cng" {')') l.'j'iej granitic", "." 
jpeg} 

penults cngOOl. cng()()2 and all objects 
of type git" and jpeg. 



CGD PROCESSING POLICY 
Rcc h'ielcl Description 



Quality-of- No This field contains tie DSC I" value 

Setviee (QoSj to he Insetted In the packet hetote 

,t is to -warded to the CGR. [f 
this value is 0, the DSCP value 
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CGD PROCESSING POLICY 



CDNflag N ) 1 'ln\ Hag indicates that the 

delivery iichwis ('< DNi II' ll is lln 
is set and the content is dynamic. 
CG will query the CON for the tn 
origin server if it is not known 

the CG will take on the role of a 
DNS pioxv that communicates wit 
CDN content routers to ascertain 
the IP address of one or more 
content delivery nodes. 
DNS server No This is IP address of the DNS 

received from the original DNS 



jr IP address(s). It' th 



to requcs s traversing transparent 
caches because HTTP requests are 
routed to a cache that is enroute 
to the target server. 
This field is relevant only if 
explicit configuration of multiple 



and the remainder backup. This 
order may change if, during the 
next refresh, one of the backup 
seivets becomes more efficient at 



What is claimed is: 

1. A system for processing a request for information in a 
network, comprising: 

a content gateway operable to receive a request for 
information from a client terminal, the request includ- so 
ing a domain name, wherein the content gateway is 
operable to communicate with a plurality of content 
providers that are represented by a plurality of content 
servers and that are operable to process the request, the 
content gateway operable to forward the request to a 55 
selected one of the plurality of content servers based on 
a domain name of the request and proximity informa- 
tion, wherein the content servers are original servers 
and the content servers can provide original informa- 
tion in response to the request; and 60 

a content gateway directory that includes a directory 
defining a classification policy and a processing policy 
for the request, the content gateway directory being 
operable to provide data to determine whether the 
domain name of the request matches the classification 65 
police in the directory, wherein the directory includes 
subscription information that reflects one or more rela- 



tionships of one or more content providers associated 
with one or more of the content servers, and wherein 
routing of the request is affected by the subscription 
information. 

2. The system of claim 1, wherein the processing policy 
in the directory identifies a source having information to 
satisfy the request. 

3. The system of claim 1, wherein the content gateway 
operates as a proxy for the client terminal with respect to an 
information source, the content gateway being operable to 
retrieve information from the information source and for- 
ward the information to the client terminal pursuant to the 
request. 

4. A method for processing a request for information in a 
network, comprising: 

receiving a request for information from a client terminal, 
the request including a domain name; 

identifying a content provider that is represented by a 
content server to handle the request according to the 
domain name of the request and proximity data; 

forwarding the request to the identified content provider, 
wherein the content server is an original server and the 
content server can provide original information in 
response to the request; and 

providing a content gateway directory that includes a 
directory defining a classification policy and a process- 
ing policy for the request, the content gateway direc- 
tory being operable to provide data to determine 
whether the domain name of the request matches the 
classification policy in the directory, wherein the direc- 
tory includes subscription information that reflects one 
or more relationships of one or more content providers 
associated with one or more of the content servers, and 
wherein routing of the request is affected by the sub- 
scription information. 

5. The method of claim 4, further comprising: 
retrieving the information from the content server to 

satisfy the request. 

6. The method of claim 5, further comprising: 
providing the information to the client terminal. 

7. The method of claim 4, further comprising: 
receiving the classification policy; 
comparing the request to the classification policy. 

8. The method of claim 7, further comprising: 
receiving the processing policy; 

determining a source of information according to the 
processing policy in response to the request matching 
the classification policy. 

9. A system for processing a request for information in a 
network, comprising: 

means for receiving a request for information from a 
client terminal, the request including a domain name; 

means for identifying a content provider that is repre- 
sented by a content server to handle the request accord- 
ing to the domain name of the request and proximity 
data; 

means for forwarding the request to the identified content 
provider, wherein the content server is an original 
server and the content server can provide original 
information in response to the request; 

means for providing a directory that includes a classifi- 
cation policy and a processing policy for the request; 

means for determining whether the domain name of the 
request matches the classification policy in the direc- 
tory, wherein the directory includes subscription infor- 
mation that reflects one or more relationships of one or 
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more content providers associated with one or more of 
the content servers, and wherein routing of the request 
is affected by the subscription information. 

10. A computer readable medium including code for 
processing a request for information in a network, the code 5 
operable to perform a process comprising: 

receiving a request for information from a client terminal, 
the request including a domain name; 

identifying a content provider that is represented by a 
content server to handle the request according to the 10 
domain name of the request and proximity data; 

forwarding the request to the identified content provider, 
wherein the content server is an original server and the 
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content server can provide original information in 
response to the request; 

providing a directory that includes a classification policy 
and a processing policy for the request; and 

determining whether the domain name of the request 
matches the classification policy in the directory, 
wherein the directory includes subscription information 
that reflects one or more relationships of one or more 
content providers associated with one or more of the 
content servers, and wherein routing of the request is 
affected by the subscription information. 
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